Speed-gradient principle for nonstationary processes in thermodynamics 
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The speed-gradient variational principle (SG-principle) is formulated and applied to thermody- 
namical systems. It is shown that Prigogine's principle of minimum entropy production and On- 
sager's symmetry relations can be interpreted in terms of the SG-principle and, therefore, are equiv- 
alent to each other. In both cases entropy of the system plays a role of the goal functional. The 
speed-gradient formulation of thermodynamic principles provide their extended versions, describ- 
ing transient dynamics of nonstationary systems far from equilibrium. As an example a model of 
transient (relaxation) dynamics for maximum entropy principle is derived. 
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I. INTRODUCTION 

The equations of motion for physical systems are of- 
ten derived from variational principles: principle of least 
action, maximum entropy principle, etc. [l], 0, in 
thermodynamics two of such principles have become well 
known during last century: Prigogine's principle of min- 
imum entropy production and Onsager 's symmetry prin- 
ciple for kinetic coefficients. Authors of both results were 
awarded with Nobel prizes. Variational principles are 
based on specification of a functional (usually, integral 
functional) and determination of real motions as points 
in an appropriate functional space providing extrema of 
the specified functional. 

In addition to integral principles, differential (local) 
ones were proposed: Gauss principle of least constraint, 
principle of minimum energy dissipation and others. It 
has been pointed out by M. Planck 0] that the local 
principles have some preference with respect to integral 
ones because they do not fix dependence of the current 
states and motions of the system on its later states and 
motions. In @, @, 0| a new local evolution principle, so 
called speed-gradient (SG) principle originated from 
the SG-design principle of nonlinear control theory 0, || 
was proposed and illustrated by a number of examples 
from mechanics. In Q SG-principle was extended to the 
case of systems with constraints. 

This paper is devoted to application of the SG- 
principle to thermodynamics. First, the formulation of 
the SG-principle is recalled. Then it is shown that Pri- 
gogine's and Onsager's principles can be interpreted in 
terms of the SG-principle and, therefore, are equivalent 
to each other. In both cases entropy of the system plays 
a role of the goal functional. The speed-gradient for- 
mulation of thermodynamic principles provide their ex- 
tended versions, suitable for the systems far from equi- 



librium. Moreover, it may describe their nonstationary, 
transient dynamics. In the paper SG-principle is applied 
to derivation of transient (relaxation) dynamics for a sys- 
tem driven by maximum entropy principle. 



II. SPEED-GRADIENT VARIATIONAL 
PRINCIPLE 

Consider a class of physical systems described by sys- 
tems of differential equations 



x = f(x,u,t), 



(1) 



where x is n-dimensional vector of the system state, u 
is m-dimensional vector of free (input) variables, x = 
dx/dt, t>0. The problem of modelling system dynamics 
can be posed as the search of a law of changing u(t) in or- 
der to meet some criterion of "natural" , or "reasonable" 
behavior of the system. Let such a behavior be specified 
as a tendency to achieve a goal, specified as decreasing 
the value of the goal functional Q(x), where Q(x) is given 
apriori. The first step of the speed-gradient procedure is 
to calculate the speed Q = ^§ = ^^-f{x,u,t). The 
second step is to evaluate the gradient of the speed V U Q 
with respect to input vector u (speed-gradient vector). 
Finally the law of dynamics is formed as the feedback 
law in the finite form 



u = -jV u Q(x,u). 



or in the differential form 
du 



(2) 



(3) 
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where 7 > is a scalar or symmetric matrix gain (pos- 
itivity of a matrix is understood as positive dcfinitcncss 
of associated quadratic form). The underlying idea of 
the choices ([2]) or ([3]) is that the motion along the anti- 
gradient of the speed Q provides decrease of Q. It may 
eventually lead to negativity of Q which, in turn, yields 
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decrease of Q. Now the speed-gradient principle can be 
formulated as follows. 

Speed-gradient principle: Among all possible mo- 
tions of the system only those are realized for which the 
input variables change proportionally to the speed gradi- 
ents u Q{x,u) of an appropriate goal functional Q(x). If 
there are constraints imposed on the system motion, then 
the speed- gradient vector should be projected onto the set 
of admissible ( compatible with constraints ) directions. 

According to the SG-principle, to describe a system 
dynamics one needs to introduce the goal function Q{x). 
The choice of Q{x) should reflect the tendency of natural 
behavior to decrease the current value Q(x(t)). Systems 
obeying the SG-principle will be called SG-systems. Be- 
low only the models |T]) in a special form are considered: 

x = u, (4) 

i.e. a law of change of the state velocities is sought. 

Note that the SG-direction is the direction of maxi- 
mum growth for Q(x,u,t), i.e. direction of maximum 
production rate for Q. Respectively, the opposite di- 
rection corresponds to minimum production rate for Q. 
The finite form © may be used to describe irreversible 
processes, while differential form ([3]) corresponds to re- 
versible ones. The SG-laws with nondiagonal gain matri- 
ces 7 can be incorporated if a non-Euclidean metric in the 
space of inputs is introduced by the matrix 7 . The ma- 
trix 7 can be used to describe spatial anisotropy. Admit- 
ting dependence of the matrix 7 on x one can recover dy- 
namics law for complex mechanical systems described by 
Lagrangian or Hamiltonian formalism. The SG-principle 
applies to spatially distributed systems where the state 
x(t) is an element of an infinite dimensional space and 
allows one to model dynamics of spatial fields [5| . 

Consider a simple illustrating example: motion of a 
particle in the potential field. In this case the vector x = 
col (x\ , x%, £3) consists of coordinates x\ , X2 , £3 of a parti- 
cle. Choose smooth Q(x) as the potential energy of a par- 
ticle and derive the speed-gradient law in the differential 
form. To this end, calculate the speed Q = [V x Q(x)] T u 
and the speed-gradient V U Q — \7 x Q(x). Then, choosing 
differential SG-law ([3]) with the gain 7 = to -1 , where 
m > is a parameter, we arrive at familiar Newton's law 
u = —m~ 1 'S7 x Q(x) or m'x — — V x Q(x). 

III. GENERALIZED ONSAGER RELATIONS 

Consider an isolated physical system whose state is 
characterized by a set of variables (thermodynamic pa- 
rameters) £i, £2, • • • j £n- Let x.i — £i — £* be deviations of 
the variables from their equilibrium values £J, £|, . . . , £*. 
Let the dynamics of the vector x%, X2, ■ ■ ■ , x n be described 
by the differential equations 

±i =u i (x 1 ,X2,---,x n ), i = l,2, ...,n. (5) 



Linearize equations ([5]) near equilibrium 

n 

Xi = -^X ik x k , i=l,2, ...,n. (6) 
fc=i 

The Onsager's principle [Ic| claims that the values Xih 
(kinetic coefficients) satisfy the equations 

Aife = Xki, i,k = l,2,...,n. (7) 

In general, the Onsager principle is not valid for all sys- 
tems e.g. for systems far from equilibrium. Its existing 
proofs [llj require additional postulates. Below a simple 
new proof is given, showing that it is valid for irreversible 
speed-gradient systems without exceptions. 

First of all, the classical formulation of the Onsager 
principle ([7]) should be extended to nonlinear systems. A 
natural extension is the following set of identities: 

du t du k 

- — {xi,x 2 , ■ ■ -,X n ) = ——(xi,x 2 , ■ ■ .,X n ). (8) 

OXk OXi 

Obviously, for the case when the system equations ([5]) 
have linear form © the identities ([5]) coincide with ([7]). 
However, since linearization is not used in the formula- 
tion ([8]) there is a hope that the extended version of the 
Onsager law holds for some nonlinear systems far from 
equilibrium. The following theorem specifies a class of 
systems for which this hope comes true. 

Theorem 1. There exists a smooth function Q(x) 
such that equations represent the speed- gradient law 
in finite form for the goal function Q{x) if and only if 
the identities (0) hold for all x%, x%, ■ ■ ■ , x n . 

The proof of the theorem is very simple. Since (0) is 
the speed-gradient law for Q(x), its right-hand sides can 

be represented in the form ui = — 7^-, i = 1,2, ... ,71. 

Therefore m = —^(dQ/dxi) (in view of Q = (\7 x Q) T u). 

Hence #^ = -7-^P- = and identities © are 

OXk 1 OXiOXk OXi 5 11 — y 

valid. Finally, the condition © is necessary and sufficient 
for potentiality of the vector-field of the right-hand sides 
of ([5]), i.e. for existence of a scalar function Q such that 

Ui = ^V X Q = "fV u Q. 

Thus, for SG-systems the extended form of the On- 
sager equations ([H]) hold without linearization, i.e., they 
are valid not only near the equilibrium state. In a spe- 
cial case the condition ([8]) was proposed in [ijj]. The 
theorem means that generalized Onsager relations © 
are necessary and sufficient for the thermodynamics sys- 
tem to obey the SG-principle for some Q. On the other 
hand, it is known that different potential functions for the 
same potential vector-field can differ only by a constant: 
Q = Q + const and their stationary sets coincide. There- 
fore, if the system tends to maximize its entropy and the 
entropy serves as the goal function for the SG-evolution 
law, then at every time instant the direction of change of 
parameters coincides with the direction maximizing the 
rate of entropy change (gradient of the entropy rate). It 
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follows from Zigler's version of maximum entropy princi- 
ple [13j that at every time instant it tends to minimize 
its entropy production rate (Prigogine principle). That 
is, if Prigogine principle holds then the generalized On- 
sager principle §8$ holds and vice versa. Note that for 
special case the relation between Prigogine principle and 
Onsager principle was established by D.Gyarmati [2(. 

For the SG-systems some other properties can be es- 
tablished. Let for example a system is governed by 
SG-law with a convex entropy goal function S. Then 
the decrease of the entropy production S readily fol- 
lows from the identities S = dS/dt — (V X S) x = 
1 (V X \\V X S\\ 2 ) T V X S = 2 1 (V X S) T IV 2 X S](V X S). 

If the entropy S(x) is convex then its Hessian matrix 
V X S is negative semidefinite: V X S < 0. Hence S(x) < 
and S cannot increase 51. 



IV. SPEED-GRADIENT ENTROPY 
MAXIMIZATION 



It is worth noticing that the speed-gradient principle 
provides an answer to the question: how the system will 
evolve? It differs from the principles of maximum en- 
tropy, maximum Fisher information, etc. providing and 
answer to the questions: where? and how far? Par- 
ticularly, it means that SG-principle generates equations 
for the transient (nonstationary) mode rather than the 
equations for the steady-state mode of the system. It al- 
lows one to study nonequilibrium and nonstationary sit- 
uations, stability of the transient modes, maximum de- 
viations from the limit mode, etc. Let us illustrate this 
feature by example of entropy maximization problem. 

According to the 2nd thermodynamics law and to the 
Maximum Entropy Principle of Gibbs-Jaynes the en- 
tropy of any physical system tends to increase until it 
achieves its maximum value under constraints imposed 
by other physical laws. Such a statement provides knowl- 
edge about the final distribution of the system states, i.e. 
about asymptotic behavior of the system when t — > oo. 
However it does not provide information about the way 
how the system moves to achieve its limit (steady) state. 

In order to provide motion equations for the transient 
mode employ the SG-principle. Assume for simplicity 
that the system consists of N identical particles dis- 
tributed over m cells. Let Ni be the number of particles 
in the ith cell and the mass conservation law holds: 



(9) 



Assume that the particles can move from one cell to an- 
other and we are interested in the system behavior both 
in the steady-state and in the transient modes. The an- 
swer for the steady-state case is given by the Maximum 
Entropy Principle: if nothing else is known about the 
system, then its limit behavior will maximize its entropy 



[T3 |. Let the entropy of the system be defined as loga- 
rithm of the number of possible states: 



S = In 



JV! 



(10) 



If there are no other constraints except normalization 
condition ([9]) it achieves maximum when N* = N/m. 
For large N an approximate expression is of use. Namely, 
if the number of particles N is large enough, one may use 
the Stirling approximation JVj! rj (Ni/e) N . Then 



N 



N, 



S w AT In N i ln — = ~ Ni ln 



N 
N 



which coincides with the standard definition for the en- 
tropy S = —J^TLiPi^Ph modulo a constant multiplier 
N , if the probabilities pt are understood as frequencies 
N/N. 

To get an answer for transient mode apply the SG- 
principle choosing the entropy S(X) = — Y^iLi NlnNi 
as the goal function to be maximized, where X = 
col(Ai, . . . , N m ) is the state vector of the system. As- 
sume for simplicity that the motion is continuous in time 
and the numbers iVj are changing continuously, i.e. iVj 
are not necessarily integer (for large iVj it is not a strong 
restriction). Then the sought law of motion can be rep- 
resented in the form 



Ni 



1,. ..,771, 



(11) 



where Ui — Ui(t), i = l,...,m are controls - auxil- 
iary functions to be determined. According to the SG- 
principle one needs to evaluate first the speed of change 
of the entropy (fit))) with respect to the system (fTTj) . then 
evaluate the gradient of the speed with respect to the 
vector of controls Ui considered as frozen parameters and 
finally define actual controls proportionally to the pro- 
jection of the speed-gradient to the surface of constraints 
(J9j> . In our case the goal function is the entropy S and 
its speed coincides with the entropy production S. In 
order to evaluate S let us again approximate S from the 
Stirling formula » (Ni/e) N : 

m m 

S = NlnN-N-^iNlnNi-Ni) = Nln N-^2 N i In N^ 



(12) 



Evaluation of S yields 



§=- J2((ui In N, + N^) = - J2 N + 1 



It follows from © that J21 



»=i 



0. Hence S 



— Y^iLx u i hi A^j. Evaluation of the speed-gradient yields 

M = - In N, and the SG-law u { = j(- ln A, + A), i = 
1, . . . , m, where Lagrange multiplier A is chosen in or- 



der to fulfill the constraint J2i 



0, i.e. A 
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— YliLi ln-^Vi- The final form of the system dynamics 



law is as follows: 



m 



^hiNi-jlnNi, i=l, 



. . , m. 



(13) 



! = 1 



According to the SG-principle the equation ([13)) de- 
termines transient dynamics of the system. To confirm 
consistency of the choice (|13l) let us find the steady-state 
mode, i.e. evaluate asymptotic behavior of the variables 
Ni. To this end note that in the steady-state Ni = and 
T^iLi m A^ = IniVi. Hence all Ni are equal: Ni — N/m 
which corresponds to the maximum entropy state and 
agrees with thermodynamics. 

The next step is to examine stability of the steady- 
state mode. It can be done by means of the entropy 
Lyapunov function V(X) = S max — S(X) > 0, where 
Smax = Nlnm. Evaluation of V yields 



V 



-s 



i=l 



Uj In N 



1_ 

m 



[(J2 In Ni) 2 -mJ2(^ N i. 



It follows from the Cauchy-Bunyakovsky-Schwarz in- 
equality that V(X) < and the equality V(X) = 
holds if and only if all the values JVj are equal, i.e. only 
at the maximum entropy state. Thus the law (|13p pro- 
vides global asymptotic stability of the maximum entropy 
state. The physical meaning of the law (|13j) is moving 
along the direction of the maximum entropy production 
rate (direction of the fastest entropy growth). 

The case of more than one constraint can be treated 
in the same fashion. Let in addition to the mass con- 
servation law © the energy conservation law hold. Let 
Ei be the energy of the particle in the ith cell and the 
total energy E = Y^iLi NiEi be conserved. The energy 
conservation law 



E = N t E t 



(14) 



appears as an additional constraint. Acting in a similar 
way, we arrive at the law (|13p which needs modification 
to ensure conservation of the energy (fl"4|) . According to 
the SG-principle one should form the projection onto the 
surface (in our case - subspace of dimension m — 2) de- 
fined by the relations 



] UiEi = 0, Uj = 0. 



(15) 



It means that the evolution law should have the form 



a, 



7(— In Ni) + XiEi + A 2 , i = l,...,m, 



(16) 



where Ai, A2 are determined by substitution of (| 16|) into 
(|15[) . The obtained equations are linear in Ai,A2 and 
their solution is given by formulas 

Al m T.T=i E 'i-{T.T=i E i) 2 ' 

(17) 

The solution of dTTJ) is well defined if m Y^T=i E f ~ 
Q2iLi Ei) 2 7^ which holds unless all the Ei are equal 
(degenerate case). 

Let us evaluate the equilibrium point of the system 
(fTTj) . (fT6|) and analyze its stability. At the equilib- 
rium point of the system the following equalities hold: 
7(-lniV i ) + Ai-Ej + A 2 = 0, % = 1, ...,m. Hence 



Ni = C exp(—fj,Ei 



1. 



. ,m, 



(18) 



where fi = A1/7 and C = cxp(— A2/7). 

The value of C can also be chosen from the normaliza- 
tion condition C = N(Y^Li exp (— fJ,Ei)). We see that 
equilibrium of the system with conserved energy corre- 
sponds to the Gibbs distribution which agrees with clas- 
sical thermodynamics. Again it is worth to note that the 
direction of change of the numbers Ni coincides with the 
direction of the fastest growth of the local entropy pro- 
duction subject to constraints. As before, it can be shown 
that V(X) = S m ax — S(X) is Lyapunov function for the 
system and that the Gibbs distribution is the only stable 
equilibrium of the system in nongenerate cases. Simi- 
lar results are valid for continuous (distributed) systems 
even for more general problem of minimization of relative 
entropy (Kullback divergence) [§]. 



Conclusions 

Speed-gradient variational principle provides a useful 
yet simple addition to classical results in thermodynam- 
ics. Whereas the classical results allow researcher to an- 
swer the question "Where it goes to?" , the speed-gradient 
approach provides an answer to the question: "How it 
goes and how it reaches its steady-state mode?" SG- 
principle may be applied to evaluation of nonequilibrium 
stationary states and study of system internal structure 



evolution 15j , des crip tion of transient dynamics of com- 
plex networks [IB, 113] j e ^ c - A different approach to vari- 
ational description of nonstationary nonequilibrium pro- 
cesses is proposed in fl8| . 
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